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DETAILED ACTION 

This action is responsive to the request for continued examination filed March 29, 2007. 
Claims 1-6, 19-21 and 26-30 are pending. Claims 1-6, 19-21 and 26-30 represent a multi-modal 
communication method. 

Claim Rejections - 35 USC § 103 

1 . The following is a quotation of 35 U.S.C. 103(a) which forms the basis for all 
obviousness rejections set forth in this Office action: 

(a) A patent may not be obtained though the invention is not identically disclosed or described as set forth in 
section 102 of this title, if the differences between the subject matter sought to be patented and the prior art are 
such that the subject matter as a whole would have been obvious at the time the invention was made to a person 
having ordinary skill in the art to which said subject matter pertains. Patentability shall not be negatived by the 
manner in which the invention was made. 

2. Claims 1-6, 19-21 and 26-30 rejected under 35 U.S.C. 103(a) as being unpatentable over 
Boloker et al. US Patent Publication No. 2002/0194388 in view of Gbadegesin US Patent No. 
6,754,709. Boloker teaches the invention as claimed including method for implementing multi- 
modal browsing (see abstract). Gbadegesin teaches the invention as claimed including an 
intelligent transparent gateway having the advantages of a proxy (see abstract). 

As per claims 1 and 26, Boloker teaches an apparatus and method for multi-modal 
communication comprising: 

a controller (the synchronization manager; pp 201); and 
a plurality of multi-modal session proxy servers [MM shells which can be implemented as any 
type of device, such as a server, 0026-0030, 0071,0074,202], having a proxy address [179] 
wherein the controller determines, on a per-session basis [0077, 223], which of the plurality of 
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multimodal proxy identifier represents the proxy address of a selected multi-modal session proxy 
server [0082, 0102, 0179] (the multi modal shell, Figure 24, pp 0073, 0090, 0201, 0202, 0206, 
0225). Boloker does not explicitly teach wherein the controller determines, on a per session 
basis, a multi-modal proxy identifier representing the proxy address of the multi-modal session 
proxy server. Gbadegesin teaches wherein the controller determines, on a per session basis, a 
multi-modal proxy identifier representing the proxy address of the multi-modal session proxy 
server. See column 8, lines 43-67 and column 9, lines 1-10. 

It would have been obvious to a person of ordinary skill in the art at the time of the 
invention to combine determining the MM shell on a per session basis of Boloker with the 
determining proxy address on a per session basis of Gbadegesin. A person of ordinary skill in 
the art would have been motivated to do this because the proxy address is a way of identifying 
the node (Boloker paragraph 0102, 0179). 

As per claim 2, Boloker teaches the apparatus of claim 1 further comprising: at least one 
browser having a per session multi-modal proxy evaluator and a browser proxy identifier, 
wherein the browser is operably coupled to the controller and the selected one of the plurality of 
multi-modal session proxy servers such that the browser receives the multi-modal proxy 
identifier and the browser proxy identifier is evaluated by the multi-modal proxy evaluator, on a 
per session basis, in response to the multi-modal proxy identifier (the multi-modal proxy 
evaluator is taught by the modal view controller (MVC )and the browser proxy ID is located in 
the wrapper (42a); Figures 23 and 25, pp. 0082, 0090, 0102, 01 12, 0179-0186, 0207, 0252). 
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As per claim 3, Boloker teaches the apparatus of claim 1 further comprising: 
at least one voice browser having a voice browser per session multi-modal proxy 
evaluator and a voice browser proxy identifier, wherein the voice browser is operably coupled to 
the controller and the selected one of the plurality of one multi-modal session proxy servers such 
that the voice browser receives the multi-modal proxy identifier and the voice browser proxy 
identifier is evaluated by the voice browser per session multi-modal proxy evaluator, on a per 
session basis, in response to the multi-modal proxy identifier (the browser is a voice browser 
which is connected to the MVC and the Multi-modal shell; pp 0183-0185, 0214, 0216); and 

at least one graphical browser having a graphical browser per session multi-modal proxy 
evaluator and a graphical browser proxy identifier, wherein the graphical browser is operably 
coupled to the controller and the selected multi-modal session proxy server such that the 
graphical browser receives the multi-modal proxy identifier and the graphical browser proxy 
identifier is evaluated by the graphical browser per session multi-modal proxy evaluator, on a per 
session basis, in response to the multi-modal proxy identifier (the browser is a graphical browser 
(GUI) which is connected to the MVC and the Multi-modal shell; pp 0183-0185, 0214, 0216). 

As per claim 4, Boloker teaches the apparatus of claim 3 further comprising: 
at least one graphical browser multi-modal synchronization interface operably coupled to 
the graphical browser; at least one voice browser multi-modal synchronization interface operably 
coupled to at least one the voice browser (each browser has an interface manager; Figure 26 and 
28, pp 0092, 0183-0187, 0201, 0226, 0228); and 
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at least one multi-modal synchronization coordinator operably coupled to the graphical 
browser multi-modal synchronization interface, the voice browser multi-modal synchronization 
interface and the multi-modal session proxy, wherein multi-modal session proxy server allows 
the multi-modal synchronization coordinator to synchronize the at least one graphical browser 
and the at least one voice browser (the browsers are synchronized by the interface manager and 
synchronization manager; Figure 26 and 28, pp 0092, 0183-0187, 0201, 0226, 0228). 

As per claim 5, Boloker teaches the apparatus of claim 4 further comprising: at least one 
information request provided by at least one of the at least graphical browser and the at least one 
voice browser to the multi-modal session proxy server whereby the multi-modal session proxy 
server fetches requested information from a content server (the MM shell gets information from 
the content server; Figure 26, pp 0082, 0092, 0 1 1 1 , 0 1 1 2); and 

wherein if the requested information is provided to the at least one voice browser, the at 
least one graphical browser is updated via the at least one graphical browser multi-modal 
synchronization interface through the multi-modal synchronization coordinator and if the 
requested information is provided to the at least one graphical browser, the at least one voice 
browser is updated via the voice browser multi-modal synchronization interface through the 
multi-modal synchronization coordinator (the information is processed through a 
synchronization coordinated and MVC; Figure 27, pp 0226-0228, 0230, 0241-0244). 

As per claims 6 and 27, Boloker teaches he apparatus of claim 1 and method of claim 26 
wherein the controller further comprises at least one load balancer whereupon the controller 
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determines the multi-modal proxy identifier in response to the at least one load balancer (pp 
0109,0226,0245) 

As per claim 19, Boloker teaches a method for multi-modal communication comprising: 
receiving a multi-modal proxy identifier, on a per session basis, for a browser based on a 
selection from a plurality of multimodal proxy servers; evaluating on a per session basis, a 
browser proxy identifier in response to receiving the multi modal proxy identifier; sending an 
information request using a first mode via a multi modal session proxy server identified by the 
multi modal proxy identifier; and receiving a reply to the request in a second mode using the 
proxy server (the multi-modal proxy evaluator is taught by the modal view controller (MVC )and 
the browser proxy ID is located in the wrapper (42a); Figures 23 and 25, pp. 0026-0030, 0071, 
0074, 0077, 0082, 0090, 0102, 01 12, 0179-0186, 202, 0207, 223, 0252) Boloker does not 
explicitly teach wherein the controller determines, on a per session basis, a multi-modal proxy 
identifier representing the proxy address of the multi-modal session proxy server. Gbadegesin 
teaches wherein the controller determines, on a per session basis, a multi-modal proxy identifier 
representing the proxy address of the multi-modal session proxy server. See column 8, lines 43- 
67 and column 9, lines 1-10. 

It would have been obvious to a person of ordinary skill in the art at the time of the 
invention to combine determining the MM shell on a per session basis of Boloker with the 
determining proxy address on a per session basis of Gbadegesin. A person of ordinary skill in 
the art would have been motivated to do this because the proxy address is a way of identifying 
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the node (Boloker paragraph 0102, 0179). 

As per claim 20, Boloker teaches the method of claim 19 further comprising: 
fetching requested information from at least one content server (the MM shell gets 
information from the content server; Figure 26, pp 0082, 0092, 0111,01 12); and 
providing the requested information to the browser (the information is processed through 
a synchronization coordinated and MVC; Figure 27, pp 0226-0228, 0230, 0241-0244). 

As per claim 21, Boloker teaches the method of claim 20 further comprising: prior to 
sending an information request, storing an updated browser proxy identifier in a memory 
location (pp 201, 202, 206, 225). 

As per claim 28, Boloker teaches the method of claim 26 further comprising: prior to 
determining a multi-modal session proxy server, on a per session basis, initiating a multi-modal 
session between a terminal and a multi-modal network element (the multi-modal proxy evaluator 
is taught by the modal view controller (MVC )and the browser proxy ID is located in the 
wrapper (42a); Figures 23 and 25, pp. 0082, 0090, 0102, 01 12, 0179-0186, 0207, 0252). 

As per claim 29, Boloker teaches the method of claim 28 further comprising: evaluating, 
on a per session basis, a browser proxy identifier in response to receiving the multi-modal proxy 
identifier; and receiving an information request from the browser to the multi-modal session 
proxy server identified by the multi-modal proxy identifier (the multi-modal proxy evaluator is 
taught by the modal view controller (MVC )and the browser proxy ID is located in the wrapper 
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(42a); Figures 23 and 25, pp. 0082, 0090, 0102, 01 12, 0179-0186, 0207, 0252). 

As per claim 30, Boloker teaches the method of claim 28 further comprising: 
fetching requested information from at least one content server (the MM shell gets 

information from the content server; Figure 26, pp 0082, 0092, 01 1 1, 01 12); and 

providing the requested information to the browser (the information is processed through 

a synchronization coordinated and MVC; Figure 27, pp 0226-0228, 0230, 0241-0244). 



Any inquiry concerning this communication or earlier communications from the 
examiner should be directed to Uzma Alam whose telephone number is (571) 272-3995. The 
examiner can normally be reached on Monday-Tuesday 5:30 AM - 2:00 PM. 

If attempts to reach the examiner by telephone are unsuccessful, the examiner's 
supervisor, Ario Etienne can be reached on (571) 272-4001 . The fax phone number for the 
organization where this application or proceeding is assigned is 571-273-8300. 

Information regarding the status of an application may be obtained from the Patent 
Application Information Retrieval (PAIR) system. Status information for published applications 
may be obtained from either Private PAIR or Public PAIR. Status information for unpublished 
applications is available through Private PAIR only. For more information about the PAIR 
system, see http://pair-direct.uspto.gov. Should you have questions on access to the Private PAIR 
system, contact the Electronic Business Center (EBC) at 866-217-9197 (toll-free). 
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